application of reinforcement learning for navigation of a planar snake robot in serpentine locomotion

this article presents an implementation of a reinforcement learning (rl) method for a snake like robot navigation. the paper starts with developing kinematics and dynamics model of a snake robot in serpentine locomotion followed by performing simulation and finishes with actual experimentation. first, gibbs-appell's method is used to obtain the robot dynamics. the robot is also modeled in simmechanics toolbox of matlab software which is then used to verify the derived dynamics equations. in this study, for the first time, q-learning method is employed to obtain the optimal state and actions. effects of serpenoid curve and body curve parameters on the snake robot learning ability are also investigated. results indicate that parameters which do not affect body shape of the snake robot, also do not affect the learning ability. finally, the experimental fum-snake ii as well as webots software are both employed to validate theoretical results. results show that the q-learning method is an effective method for navigation of snake like robot.